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OPTICAL METHOD OF DETERMINING A PHYSICAL ATTRIBUTE OF A 

MOVING OBJECT 

5 

Field of the Invention 

The present invention relates to an optical method for determining a physical attribute 
10 of a moving object. The present invention also relates to a method for optically 

establishing a mathematical spatial relationship between one or more cameras and one 
or more fanned lasers each capable of projecting a laser beam along a laser plane. 



15 Background of the Invention 

A number of optical methods and systems are readily available for determining the 
physical attribute of an object such as the dimension of an object or its orientation. In 
particular, there exists a number of dynamic measuring systems based on the 

2 0 combination of fanned laser beams and digital cameras. A fanned laser beam emits a 

fan of laser rays, emanating from a centre of the laser, which all lie in a common plane; 
that is, the plane of the fanned laser, or the "laser plane". When the fanned laser 
illuminates a body, the laser rays create a line on an outer surface of the body which is 
the intersection of the laser plane with the outer surface of the body. 

25 

The line created by the fanned laser can be recorded by a digital camera as a two- 
dimensional image. If the line created by the fanned laser is recorded by a digital 
camera, and the fanned laser and digital camera are in a fixed position relative to each 
other, then it can be shown mathematically that each point in the camera's view 

3 0 illuminated by the laser can be resolved into a three dimensional position in any 

particular co-ordinates, provided the orientation of the laser plane, and the position and 
orientation of the camera are predefined precisely in co-ordinates related to the body 
being observed, and provided the camera's optical settings and characteristics are also 
known. 

35 

In industrial applications setting the lasers and cameras into precisely known 
orientations relative to the body being measured is difficult and sometimes impractical. 
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An object of the present invention is to provide an optical method for determining a 
physical attribute of an object utilising fanned lasers and digital cameras which does not 
require precise mechanical setup of the three dimensional location and orientation of the 
5 fanned lasers and digital cameras relative to the moving object. 

Summary of the Invention 

According to a first aspect of the present invention, there is provided a method for 
1 0 optically determining a physical attribute of an object moving along a defined path, the 
method comprising the steps of: 

fixing one or more cameras, each camera being located to view the object 

when the object is at a trigger location; 
fixing one or more fanned lasers, each laser being located outside the path and 
1 5 projecting a laser beam along its laser plane onto the object when the 

object is at the trigger location, the intersection of the laser plane with 
the object at the trigger location being visible by at least one of the 
cameras; 

optically establishing a mathematical spatial relationship between the cameras 
2 0 and the plane of each of the laser beams; 

creating a pixelated image of the object in one or more of the cameras 

illuminated by the planar laser beams when the object is at the trigger 

location; 

selecting at least one pixel location in each image, the at least one pixel 

2 5 location corresponding to a point on the object illuminated by a laser 

beam; 

for each of the selected pixel locations, using the mathematical spatial 

relationship to establish the three dimensional position of the point based 
on the two dimensional position of the pixel location; 

3 0 using the three dimensional position of the respective point to determine the 

physical attribute of the object. 

Preferably, optically establishing a mathematical spatial relationship further comprises: 
establishing an orientation and location of each camera with respect to a co- 
3 5 ordinate system; 

establishing an orientation of each laser plane within the co-ordinate system; 
and 
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deriving a transformation function for calculating the three dimensional 

position of points within the plane of each respective laser beam from the 
pixel location within a pixelated image. 

5 Preferably, establishing an orientation and location of each camera further comprises: 

temporarily mounting a calibration device having at least six non-collinear 

visible markings at known points on at least two non-parallel surfaces of 
the calibration device, the calibration device being positioned in the path 
and in view of each camera at a reference position such that each camera 
1 0 can view the at least six points; 

for each camera, creating a first pixelated image of the calibration device; and 
using the known position of the at least six markings relative to the co-ordinate 
system and the pixel locations within the first image to establish a 
transformation equation between pixel locations and the three 
1 5 dimensional co-ordinates of the calibration device at the reference 

position. 

Preferably, establishing an orientation of each laser plane within the co-ordinate system 
further comprises: 

2 0 illuminating the calibration device with each laser beam to form a line along 

the surface of the calibration device; 
for each camera, creating a second pixelated image of the calibration device; 
and 

using the position of at least three non-collinear points within the line relative 
25 to the co-ordinate system and the pixel locations corresponding to the 

positions of the points within the second image to establish an equation 
defining the orientation of the laser. 

The first pixelated image may also be the second pixelated image. 

30 

Preferably, a pixel location is defined to sub-pixel accuracy using image analysis 
techniques. 



35 



According to a second aspect of the present invention, there is provided an optical 
method for determining a physical attribute of an object moving along a defined path, 
the method comprising: 
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fixing at least one fanned laser at a position outside of the path to project its 

laser beam onto the moving object when the moving object is at a trigger 
location; 

fixing at least one camera at a location to view the moving object when 
5 illuminated by the laser beam at the trigger location, each camera 

producing a digital image comprising an array of pixels; 
forming a calibration device comprising two planar surfaces which intersect in 
a line forming an edge of the device and, at least six non-collinear visible 
points on the planar surfaces at known locations on the calibration device 
1 0 defining a calibration co-ordinate system; 

temporarily mounting the calibration device in the path in view of the at least 

one camera, and where illuminated by the at least one fanned laser; 
producing an image of the device on each camera and determining for each of 
one or more pixel locations within the image an equation in terms of the 
1 5 calibration co-ordinate system, of a ray passing through a centre of lens 

of the camera which, when projected onto the device coincides with the 
pixel location; 

determining an equation of a plane in the calibration co-ordinate system 
containing the fanned laser beam; 
2 0 removing the calibration device; 

taking an image of the object when illuminated by the at least one laser beam 
at the trigger location and utilising the laser plane equations, determining 
a three dimensional location in the calibration co-ordinate system of 
selected pixel locations of the object illuminated by the at least one laser, 

2 5 and from the three dimensional locations determining physical attribute 

of the object. 

Preferably, forming said calibration device further comprises arranging said first and 
second planar surfaces at right angles to each other. 

30 

Preferably, forming said calibration device further comprises providing a third planar 
surface having a first edge coincident with an edge of said first planar surface distant 
said second planar surface, and a fourth planar surface having a first edge coincident 
with an edge of said third planar surface distant said first planar surface, and a second 

3 5 edge coincident with an edge of said second planar surface distant said first planar 

surface. 
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According to a third aspect of the present invention, there is provided a method for 
optically establishing a mathematical spatial relationship between one or more cameras 
and one or more fanned lasers each capable of projecting a laser beam along a laser 
plane, the method comprising: 
5 establishing an orientation and location of each camera with respect to a co- 

ordinate system; 

establishing an orientation of each laser plane within the co-ordinate system; 
and 

deriving a transformation function for calculating the three dimensional 
1 0 position of points within the plane of each respective laser beam from a 

pixel location within a pixelated image created by each of the cameras. 

Brief Description of the Drawings 

15 

In order that the invention may be more easily understood, an embodiment will now be 
described, by way of example only, with reference to the accompanying drawings, in 
which: 

2 0 Figure 1 is a perspective view from the side of a pantograph on the roof of an 
electrically powered train; 

Figure 2 is a perspective view from the front of a pantograph head; 

2 5 Figure 3 is a view of section A-A of the pantograph head depicted in Figure 2; 

Figure 4 illustrates an optical measurement system incorporating an embodiment of the 
present method; 

3 0 Figure 5 is an enlarged view of the system shown in Figure 4 from the perspective of 

one camera incorporated in the system; 

Figure 6 is a view of a pantograph head illuminated by a plurality of fanned lasers 
incorporated in the system shown in Figures 4 and 5; 

35 

Figure 7 is a cross-sectional view of a portion of the pantograph head as viewed by a 
camera in the system depicted in Figures 4 and 5; 
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Figure 8 is a schematic representation of a portion of the calibration device incorporated 
in an embodiment of the present method; 

5 Figure 9 is an illustration of the measurement system during a calibration process; 

Figure 1 0 is a photograph of the calibration device incorporated in the present invention 
when viewed from one of the cameras in the system depicted in Figures 4 and 5; 

1 0 Figure 1 1 is a photograph of the calibration device when viewed from another of the 
cameras incorporated in the system shown in Figures 4 and 5 and illuminated by a 
plurality of fanned lasers; 

Figure 12 illustrates the co-ordinate systems of major components of the system 
1 5 illustrated in Figures 4 and 5; 

Figure 1 3 illustrates the relationship between the co-ordinate systems of an image plane 
of a camera incorporated in the system, the camera, and the calibration device; 

2 0 Figure 14 illustrates a fanned laser illuminating the calibration device; 

Figure 15 illustrates the orientation of the pantograph head; 

Figure 16 is a representation of a portion of the pantograph as seen by one of the 

2 5 cameras in the system shown in Figures 4 and 5; 

Figure 17 is a schematic representation of a method for fitting a cylinder profile to the 
pantograph head; 

3 0 Figure 1 8 depicts various planes on the pantograph carbon and carrier; 

Figures 19a and 19b illustrate the geometry in the process of fitting a cylinder to the 
pantograph head; and, 

3 5 Figure 20 illustrates the geometry in measuring the thickness or height of the 
pantograph carbon. 
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Detailed Description 

An embodiment of the present invention is described in relation to a pantograph of an 
5 electrically powered train. As shown in figures 1 to 3, the pantograph head 10 

comprises two or more parallel and spaced apart metal beams 12a and 12b (hereinafter 
referred to collectively as "beams 12"). Each beam 12a, 12b comprises a metal section 
13 a, 13b (hereinafter referred to collectively as "metal sections 13") to which carbon 
bushes 14a and 14b (hereinafter referred to collectively as "carbons 14") are attached. 
1 0 The metal sections 13 together are known as the "carrier". 

The beams 12 and carbons 14 extend transversely to an overhead wire 16 from which 
the train derives electric current for powering its motor(s). The pantograph head 10 and 
wire 16 are generally orientated so that the wire contacts the carbons 14 in a region 
1 5 about their mid-point. The carbons 14 have a central portion 1 8 which comprises the 
majority of its length and is of uniform thickness h, and contiguous end portions 20 
which reduce in thickness. In use, the wire 16 is substantially always maintained in 
contact with the central portion 1 8 of the carbons 14. 

2 0 Throughout their service life, the carbons 14 wear due to contact with the wire 16, and 
occasionally are damaged through contact with foreign objects. The wear is reflected in 
a decrease in the thickness h of the carbons 14. Damage through contact with foreign 
objects is reflected in the removal of chunks of material from the carbons 14. 

2 5 Embodiments of the present invention provide for an optical system and method for 

determining a physical attribute of a moving object, without requiring precise 
mechanical set-up of various elements of an associated optical measurement system 22. 
In the present embodiment, the moving object is the pantograph 10 or more particularly 
the carbons 14, and the physical attribute to be determined is the thickness h of the 

3 0 carbons 14 along their length. 

Figure 4 depicts the general set-up of the optical system 22. The system comprises 
three fanned lasers 24a, 24b and 24c (hereinafter referred to collectively as "lasers 24") 
which are supported at a vertical distance hi above the wire 16; and, two digital 
3 5 cameras 26a and 26b (hereinafter referred to collectively as "cameras 26") which are 
located a vertical distance h2 below the wire 1 6 on either side of the pantograph head 
10. Each of the lasers 24a-24c produces a corresponding laser plane 28a-28c 



WO 2005/090903 PCT7AU2005/000406 

-8 - 

(hereinafter referred to in general as "laser plane 28"). Each laser plane 28 is a plane 
containing all the laser rays emitted from the respective laser 24. The lasers 24 emit 
radiation of a visible wavelength and thus when the lasers 24 project light onto or 
illuminate the pantograph 10 they each produce two visible laser stripes 32, which 
5 correspond to the intersection of the pantograph head 1 0 with the respective laser plane 
28. The laser 24a produces laser stripes 32a and 32b on beams 12a and 12b 
respectively, laser 24b produces laser stripes 34a and 34b on beams 12a and 12b 
respectively, and laser 24c produces laser stripes 36a and 36b on beams 12a and 12b 
respectively. 

10 

Each of the cameras 26 looks upwardly at the pantograph head 10 toward backboards 
38a and 38b respectively which are supported above the wire 16. The camera 26a 
views the stripes 32a, 32b, 34a and 34b, while the camera 26b views the stripes 34a, 
34b, 36a and 36b. The backboards 38a and 38b allow the cameras 26 to record a 
1 5 silhouette of the pantograph head 1 0, and in particular the carbons 14. 

* « 

The lasers 24, cameras 26 and backboards 38 are all supported in locations outside of 
the path of motion of the pantograph 10 and the train to which it is coupled. 

» 

♦ 

20 In addition, the lasers 24 and cameras 26 are arranged so that the laser planes 28 are not 
parallel to the image plane of the cameras nor passes through the camera origin. It will 
be appreciated that the sensitivity of the system 22 decreases as the angle between the 
laser plane 28 and the axis normal to the image plane approaches 0°. Preferably, the 
laser planes 28 are about 45° to the axis normal to image plane. 

25 

The system 22 is arranged to view the front of the pantograph 1 0 relative to its direction 
of motion. A second identical system may also be provided to view the opposite or 
reverse side of the pantograph head 10. This will enable measurement of the carbons 
14 from opposite sides. 

30 

The following description is made in relation to only one of the cameras 26a of the 
system 22 as the operation of the system 22 and the associated method is identical for 
the camera 26b and indeed for corresponding cameras in an identical system (not 
shown) viewing the rear side of the pantograph head 10. 

35 

Figures 5 and 6 depicts the view of the pantograph head 1 0 as observed by camera 26a 
when illuminated by the lasers 24a and 24b. The camera 26a is able to see, against the 
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backboard 38a 5 laser stripes 32a and 32b, 34a and 34b and 36b. However, the capture 
of the image of stripe 36b is not critical. 



Figure 7 depicts in cross-section the beam 12a at a location in which the beam 12a is 
5 illuminated by the laser 24a. The laser 24a produces the stripe 32a which is depicted in 
heavier line. This stripe 32a extends across an upper surface 40 of the carbon 14a down 
a front surface 42 of the carbon 14a, along an upper surface 44 of the metal section 13a 
and down a front surface 46 of the metal section 13a terminating at a lowest point 48. 
The lowest point 48 coincides with leading or front bottom corner of the metal section 
10 13 a. The beam 1 2a as viewed by the camera 26a has a silhouette of a width W. 

However, the true height or thickness of the entire beam 12a is height H. The height H 
is a combination of the thickness of the metal section 13 a, which remains constant 
throughout the life of the pantograph head 10, and the thickness h of the carbon 14a, 
which decreases in time due to wear. 

15 

As discussed in further detail below, knowing the location in three dimensions of the 
equivalent corner point 48 for each of the laser stripes 32a, 32b, 34a and 34b gives four 
points on the surface of the pantograph head 1 0. From these points, the orientation of 
the pantograph head 10 can be determined. Further, from the knowledge of the 
2 0 orientation of the pantograph head 10, relative to the camera 26a, a transformation 

between the silhouette width W and the height H can be derived and thus the thickness 
h of the carbon 14 determined. 

As mentioned in the Background of the Invention, it is possible to determine the three 

2 5 dimensional location of a point illuminated by a laser if the position of the laser and 

position and direction of the camera are precisely defined relative to the body being 
observed. However, it will be appreciated that determining these positions particularly 
having regard to the lasers and cameras being located off the ground precise 
measurement of the location of the cameras and lasers is impractical. 

30 

Embodiments of the present invention enable such a relationship to be determined 
without the need to physically measure with precision the location and orientations of 
the lasers 24, cameras 26 and pantograph head 10. Rather, the present method utilises a 
calibration process and a calibration device to determine the relative orientations of the 

3 5 camera 26 and laser planes 28. 
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In the embodiment shown in figures 8 to 1 1 , the calibration device, in the form of a 
calibration "block" 50, comprises two planar non-parallel surfaces 52, 54, each 
composed of corresponding precise rectangular plates which intersect at a line or edge 
56. Ideally, although not necessarily, the surfaces 52 and 54 are at right angles to each 
5 other. An edge 58 of the surface 52, and adjacent edge 60 of the surface 54, together 
with the edge 56 are machined to create a precise set of rectangular axes with a vertex 
at a corner O. In other words, edges 56, 58, 60 are mutually orthogonal and intersect at 
the corner O. 

1 0 Each of the surfaces 52 and 54 of the calibration block 50 is provided with at least three 
markings in the form of dots 62 created by drilling corresponding small holes (of 
approximately 5mm diameter) through the plates. Each drilled hole is filled with 
translucent material of visually contrasting colour to the surfaces 52 and 54 (for 
example the surfaces may be black in colour and the translucent material white). To 

1 5 highlight the dots 62, the device 50 may be backlit from the rear. The dots 62 are 
positioned at random or pseudo-random locations on their respective surfaces. The 
location of each dot 62 on the surface 52 is precisely known relative to edges 56 and 58. 
Similarly, the location of each dot 62 on the surface 54 is precisely known relative to 
the edges 56 and 60. The location of the dots 62 is held in a look up table on a 

2 0 computer. 

In the event that the system 22 is to be used to measure the characteristics of the 
pantograph head 10 from both the front and the rear, the device 50 will comprise two 
further surfaces (not shown) of identical configuration to the surfaces 52 and 54 and 

2 5 attached to the surfaces 52 and 54 to form a box-like structure comprising the surface 

52, the surface 54 a further surface parallel to the surface 52 and a further surface 
parallel to the surface 54. 

In order to calibrate the system 22, the calibration block 50 is temporarily supported at a 

3 0 location corresponding generally to a location through which the pantograph head 10 

will pass. The calibration block 50 must be stationary, in the field of view of all 
cameras, and in a position where all lasers 24 shine across the surfaces 52, 54. 
Theoretically, it is possible to set the calibration block 50 at any orientation relative to 
the local world co-ordinates. The orientation of the pantograph head 10 can be 
3 5 computed in the local world co-ordinates so long as it is possible to compute the 

transformation from the calibration device orientation to the local world co-ordinates. 
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Calibration of the system 22 is simplified by orientating the calibration block 50 during 
the calibration process so that the edge 56 is generally transverse to the rails. Referring 
to Figure 9, the calibration block 50 is orientated so that it is set in essentially the same 
as the location in which the pantograph head 10 is to be measured (the "trigger 
5 location"). Accordingly, the calibration block 50 will be placed in the path of the laser 
planes 28 and in view of the cameras 26. The physical location of the calibration block 
50 does not need to be precise, provided it is in the field of view of the cameras 26 and 
is illuminated by the lasers 24. A mechanical frame (not shown) supports the 
calibration block 50 in a location so that the surfaces 52 and 54 are approximately at 
1 0 45° to the horizontal, an upper edge 64 of the calibration block 50 contacts the wire 16 
and the edge 56 of the calibration block 50 lies approximately square to the rails. 

Figure 10 shows an actual calibration block 50 as viewed by the camera 26a prior to 
illumination by the lasers 24. The dots 62 are clearly visible in an image plane of the 
1 5 camera 26a. 

Figure 1 1 depicts the calibration block 50 as viewed by the camera 26b when 
illuminated by lasers 24b and 24c and showing corresponding laser stripes 66b and 66c. 
The laser 24a also produces a visible stripe 66a on the calibration block 50 which is in 
2 0 the field of view of camera 26a. 

The calibration of the system 22, which enables the location of the lasers 24 and 
cameras 26 to be determined in a calibration co-ordinate system corresponding to the 
co-ordinate system of the device 50, is described below. Clearly, the location of the 

2 5 origin of the calibration co-ordinate system is arbitrary. However, it will be appreciated 

that in practice the calibration process is simplified if the origin is located within the 
calibration device. In this embodiment, the origin of this co-ordinate system is in the 
middle of the device. 

3 0 Broadly speaking, the method of calibration establishes the position and orientation of 

the cameras 26, and the orientation of the laser planes 28, relative to a common co- 
ordinate system. In this embodiment, the common co-ordinate system is defined by the 
calibration block 50 (namely, the calibration co-ordination system), and the equations 
of the laser planes 28 are defined relative to the calibration co-ordination system. 

35 
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Accordingly, in this embodiment, the three dimensional location of any point 
illuminated by a laser stripe 32 on the pantograph head 10 (or any other object) when 
viewed by one of the cameras 26 can be determined. 

5 As previously stated, each laser 26 emits a corresponding plane of light, i.e. a laser 
plane 28. The equation of any one of these planes can be expressed in vector form by 
the equation: 

n-w = c [Eqn. 1] 

where n is the unit vector normal to the plane, w is a point on the plane and c is 
10 a scalar equal to the distance of the point from the origin O of the calibration device. 

The orientation of the laser plane 28 is entirely arbitrary. However, it is practical to 
align it as close as possible to be vertical. 

1 5 The image produced by each camera 26 is a regular two dimensional rectangular array 
of pixels. Standard image processing techniques are used to determine locations of 
items of interest within the array of pixels to sub-pixel accuracy. All references to pixel 
position or location can be a continuous real number rather than a discrete integer 
number. 

20 

A given pixel position (p x , p y ) in the image relates to a single ray in three dimensional 
space defined by the camera co-ordinate mapping transformation (i.e. camera 
orientation). This ray will intersect a laser plane 28 in a unique point in three 
dimensional space. Hence, if the mathematical relationship of the laser plane 28 and 

2 5 the rays from the camera 26 can be defined then the three dimensional position of any 

point illuminated by the laser can be computed from its corresponding pixel co- 
ordinates. This is true for all points on the stripes 32a, 32b, 34a, 34b, 36a and 36b 
traced on the pantograph. 

3 0 In this analysis it is assumed that the lasers 26 and cameras 24 can be positioned fairly 

accurately, but not with enough precision to allow a hard-coded transformation between 
the camera image and the laser position. This transformation is determined by 
calibration. The accuracy of this system depends on the calibration process rather than 
the physical camera and laser setup. 

35 
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Calibration is used to define the relationship between the three dimensional co-ordinate 
system used (the calibration device co-ordinates) and the two dimensional image co- 
ordinates. 



20 



The system 22 incorporates five co-ordinate systems, as shown in Figure 12; namely: 
Image co-ordinate system: This defines the location of each pixel on the image plane 
of the camera 26 producing the image. The image plane is parallel to the lens 
(which corresponds to the x-y plane in the camera co-ordinate system), 
ra co-ordinate system: This is the co-ordinate system of a camera 26 with the 



1 0 origin at the centre of its lens and the z-axis extending directly through the 

centre of the lens and normal to the lens. 
Calibration co-ordinate system: The co-ordinate system defined from the calibration 
process using the calibration device. For convenience the axes are aligned 
approximately with the local world co-ordinate system. This helps to relate 
15 orientation attributes of the measured object, such as pitch, roll and yaw, to the 

local co-ordinates. 



local co-oramates. 

Pantograph co-ordinate system: The co-ordinate system defined square to the 
pantograph, with the origin in the centre of the pantograph. 

Local world co-ordinate system: The absolute co-ordinate reference system, having a 
first vertical axis, a second axis parallel to the rails on which the train carrying 
the pantograph head 1 0 travels, and a third axis square to the rails. 



Figure 13 shows the relationship between the following three co-ordinate systems: 
Calibration (3D) co-ordinate system (designated w); 
2 5 Camera (3D) co-ordinate system (designated c); and, 

Image (2D) co-ordinate system (designated £). 

The image co-ordinates of a pixel are related to the camera co-ordinates by: 

z 

p y =^ L = Tan(0 x ) => c y -p y c z =0 
30 c * [Eqn. 3] 

In which the c z term is a perspective scaling factor. 



The calibration co-ordinates are related to the camera co-ordinates by 
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[Eqn. 4] 



where # is the matrix which defines the transformation from the calibration co- 
ordinate system w to the camera co-ordinate system c. 



10 



The terms h\\ to A33 define rotation and the terms hu, hi^ A34 define translation. If the 
z-origins of the two co-ordinate systems do not coincide (that is, h& 7*0) then the entire 
system can be divided by A34 to reduce the number of unknowns. This has no effect on 
p x and p y as the numerator and denominators in Equation 1 and Equation 2 have both 
been divided by ^ 34 . Therefore the term A34 = 1 , as shown in Equation 4. Independent 
scaling of the pixel co-ordinates is incorporated in H. 



Expanding Equation 4 and substituting into Equation 2 and Equation 3 gives two 
equations, which can be written as a single equation in matrix form, as follows: 



15 
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[Eqn. 5] 



The two sets of equations have eleven unknowns. To find a solution requires at least 
six points on a minimum of two non-parallel planes. Each plane must have at least two 
2 0 points and no three points can be collinear. Of course, more points can be used to apply 
a least squares fit. 

The inverse matrix of H (that is, IT 1 ) defines the transformation from camera co- 
ordinates to calibration co-ordinates. 
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Each vector corresponding to a ray extending from a respective point through the 
camera lens passes through the camera origin in the centre of the lens: c 0 = (0, 0, 0, 1) T . 
In the calibration co-ordinate system, the location of the origin of the camera co- 
5 ordinate system is given by the vector: wo = IT 1 cq. 

On the camera plane c z = 1 , and hence the image co-ordinates £ = (p x , p y ) correspond to 
c\ = (py^py, 1, 1) T . In calibration co-ordinates: w\ = IT 1 c\. 

1 0 Each point in the image corresponds to a ray extending from the centre of the camera 
lens: 

Mt) = w 0 +t-(w 1 ~w 0 ) [Eqn. 6] 

where t >0 is the parametric variable 

15 

It will be appreciated that any plane normal to the camera's z-axis can be used instead 
of the camera plane, in which c z = 1 . When using an alternative plane the parametric 
variable will be rescaled. 



2 0 If the plane in which a point on the object lies is known then the location of that point, 
in the calibration co-ordinate system, can be determined from the image co-ordinate by 
the intersection of the ray and the plane (from equation 1 , n • w = c ), provided the ray 
and plane are not parallel: 

25 t = — 0 [Eqn. 7] 

n^{w x -w Q ) 



During the calibration process, both surfaces 52 and 54 of the calibration block 50 must 
be visible by the associated cameras 26 and the laser planes 28 must also intersect both 
surfaces 52, 54. 

30 

The following process can be used to calibrate the system 22: 

Move the calibration block 50 to position where it is within each camera's field of 
view and the various laser stripes intersect it. For convenience the 
calibration block 50 is orientated approximately square to the rails and in 
3 5 the expected location of the pantograph head 10, as discussed previously. 
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Determine the transformation matrices for all cameras 26 by using the known 

position of the dots 62. Each dot 62 is located in pixel co-ordinates to sub- 
pixel accuracy. At least six dots 62 are required to find the solution for 
Equation 5 as described above. More points can be used in a least squares 
fit which also provides a measure of the accuracy of the result. 
Use the stripes 66 (see Figure 9) traced by the lasers 24 on the surfaces 52, 54 to 
determine the planes 28 of the lasers 24. In this regard, it is noted that three 
points (which are not collinear) are required to define each plane 
(ax + by + cz = l). This requires that the stripes 66 illuminate at least part of 
both calibration block 50 surfaces. More than three points may be used for 
a least squares fit. In vector form, the orientation of each laser plane 28 can 
be expressed as follows: 



x 



[a b c\y 

z 



[Eqn. 8] 



1 5 The three points may be for example for laser plane 28a, two points on the 

portion of stripe 66a on surface 52 and one point on the portion of stripe 66a 
on surface 54. 

The transformation process uses the information determined by the calibration to 
2 0 calculate the co-ordinates of the pantograph head 1 0, as seen in an image taken by one 
of the cameras 26. Figure 15 defines the orientation of the pantograph head 10 for the 
system 22 which measures the carbons 14 from the front and back of the pantograph 
head 10. In figure 15, lasers 24d, 24e and 24f are provided for illuminating the back of 
the pantograph head 10. 

25 

The following process describes how the height (which also provides the thickness) of 
the carbons 14 on the outside of the near beam 12a and the inside of the far beam 12b 
can be determined using the silhouette of the pantograph head 1 0 in the image(s) 
captured by the system 22. 

30 

An image of the pantograph head 10 is taken as the train moves past by each of the 
cameras 26. A triggering mechanism, (such as a mechanical, electro-magnetic or 
optical, or any other appropriate sensing means) senses when the pantograph head 1 0 is 
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in the correct position (that is, the trigger location) for the cameras 26 to each take an 
image. 

The two laser stripes 66 are located in each image on the carrier (the images from the 
5 two cameras 26a, 26b will share a common laser stripe 66, being the stripe produced by 
the middle laser 24b). Each laser stripe 66 will form two lines; a first line along the 
side of the carbon 14 and a second along the side of its corresponding metal section 13. 
As shown in figure 16, the two lines will not be parallel and may be discontinuous. 
This is due to the laser position, the shape of the metals sections 12 and the camera 
1 0 angle. 

The lowest endpoint of each stripe across the metal section 1 3 provides a known point 
on the bottom of the near side of the beam 12. It should be noted that the beams 12 are 
shown in the figures not straight but are manufactured with a curvature, typically of a 
15 radius of about 10 metres. However, the curvature may vary for different suppliers. 
Moreover, the beams could be flat. The present method is applicable to all possible 
configurations, but is described in relation to curved beams. 

Two pairs of lowest endpoints on each of the near and far beams 12a and 12b allow a 

2 0 cylinder to be fitted to match the curvature of the beams 12 (see figures 17, 19a and 

19b). The cylinder's longitudinal axis is normal to the pantograph's x-z plane. The 
orientation of the cylinder 5 s axis gives the pitch and yaw (relative to the calibration co- 
ordinate system) of the pantograph head 1 0. 

25 As shown in Figure 1 8, three planes can be defined based upon the cross sectional 

profile of the pantograph. These three planes are normal to the cylinder's axis, and are 
each offset from the lowest endpoint on the near side of a beam 12 by fixed distance 
which is based on the (known) geometry of the metal beams 13. The three planes are 
defined as follows: 

3 0 Carbon plane: Along the near face of the carbon 14, with respect to the cameras 

26. The location of this plane will allow the 3D co-ordinates of the top near 
edge Ct of the carbon to be determined from the silhouette. , 
Carrier plane: Along the far edge of the underside of the carrier, with respect to 
the cameras 26. The location of this plane will allow the 3D co-ordinates of 
3 5 the bottom far edge fe/ of the beam 12 (i.e. metal section 13) to be 

determined from the silhouette. 
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Feature plane: Along the underside of the carrier 12, aligned with a feature point, 
this will allow the location of features to be determined. A feature point is 
any known point which would appear in the silhouette. For example it may 
be the location of a bolt passing through the metal section 13. 

5 

Each of these planes is defined in calibration co-ordinates. 

The co-ordinates of points along the top Q and bottom b% of the silhouette of each beam 
12a and 12b are determined to sub-pixel accuracy in pixel co-ordinates using standard 
1 0 image analysis techniques. 

The pixel co-ordinates of the top Q of the silhouette also lie in the carbon plane. The 
intersection of these pixel vectors and the carbon plane is used to transform these 
silhouette points from pixel co-ordinates to calibration co-ordinates. 

15 

The pixel co-ordinates of the bottom b t of the silhouette also lie in the carrier plane. 
The intersection of these pixel vectors and the carrier plane is used to transform these 
silhouette points from pixel co-ordinates to calibration co-ordinates. 

2 0 The pantograph head pitch determined above by fitting a cylinder is used to rotate the 
silhouette points from calibration co-ordinates to pantograph co-ordinates. 

The pantograph beam height is taken as the vertical difference in the silhouette top Q 
and bottom b t point sets in pantograph co-ordinates. Accordingly, if the physical 

2 5 dimensions of the pantograph carrier 13 are known, the height of the carbons 14 can be 

determined. 

In addition, matching known features from the feature plane on the bottom edge of the 
carrier will allow the position of the pantograph head 1 0 to be determined from its 

3 0 profile (in calibration co-ordinates), and the mid point of the carrier to be determined. 

The roll of the pantograph head 10 can be determined by fitting a circle to the points in 
the carrier plane. The relative position of the centre of this circle, in relation to the mid 
point of the carrier, will determine the roll. 

35 

Data from the left and right side images are merged to form a complete profile of the 
pantograph head 10. 
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Now that an embodiment of the present invention has been described in detail it will be 
apparent to those skilled in the relevant arts that numerous modifications and variations 
may be made without departing from the basic inventive concepts. In particular, the 
5 present embodiment is described in relation to a pantograph. However the invention is not 
limited to application to a pantograph and may be applied to other moving objects such as, 
for example a wheel of a train. The particular application required will determine the 
number of fanned lasers and cameras required. If the present system is adapted to measure 
for example the tread thickness on a train wheel, a single fanned laser producing a laser 
1 0 stripe passing along a radius of the wheel is required. 

The calibration block 50 in the embodiment described above has two mutually orthogonal 
surfaces which intersect at a line for each system 22. However, it will be appreciated that 
other calibration devices may be employed. For example, a calibration device may have 
surfaces which are not mutually orthogonal. Alternatively or additionally, a calibration 
device may have more than two surfaces. It is also possible to use a calibration device in 
the form of a cylinder. However, it will be appreciated that the complexity of the 
mathematics associated with establishing a mathematical spatial relationship between the 
cameras 26 and the laser planes 28 is at least partly dependent on the shape of the 
calibration device. 

Modifications and variations of the present invention which would be obvious to a person 
of ordinary skill in the art are deemed to be within the scope of the present invention the 
nature of which is to be determined from the above description and the appended claims. 
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